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5 

CROSS REFERENCE TO RELATED APPLICATIONS 

The present application claims benefit of U.S. Provisional Patent 
Application No. 60/484,282 filed on July 2, 2003, entitled "Gear-on" listing the 
same inventors, the disclosure of which is hereby incorporated by reference. 

10 

FIELD OF THE INVENTION 

The present invention relates generally to managing and presenting 
content and, more particularly, to managing and presenting content through a 
spherical display device. 

15 

BACKGROUND 

There are many personal video cameras in use. With the increase in 
quality of personal video cameras and decrease in cost and size of these 
cameras, it is getting easier and cheaper for individuals to capture high quality 

20 video footage of events detailing their lives. For example, many users capture 
traditional events such as vacations, birthdays, and weddings with their video 
cameras. With the increase in portability of modern personal video cameras, 
users are also capturing video footage of their hobbies that reflect their active 
lifestyles such as skiing, mountain climbing, mountain biking, kayaking, sky- 

25 diving, and the like. 



PATENT 
SONY-06802 

With the increase in use of personal video cameras, there is an increasing 
amount of video footage recorded by users. Although potentially more video 
footage is captured, the amount of time and desire dedicated to spend viewing 
the captured video footage does not necessarily increase. Accordingly, there is 
5 an increasing demand to improve the quality of the captured video footage. 
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SUMMARY 

In one embodiment, the methods and apparatuses display a first content 
5 on a flat display surface within a spherical display; simultaneously display a 
second content on a spherical display surface within the spherical display; and 
scroll through the second content based on instructions while displaying the first 
content, wherein the spherical display surface is imposed over the flat display 
surface such that the first content and the second content are distinctly and 
10 simultaneously viewed. 
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BRIEF DESCRIPTION OF THE DRAWINGS 

The accompanying drawings, which are incorporated in and constitute a 
part of this specification, illustrate and explain one embodiment of the methods 
5 and apparatuses for managing and presenting content through a spherical 
display device. In the drawings, 

Figure 1 is a diagram illustrating an environment within which the methods 
and apparatuses for managing and presenting content through a spherical 
display device are implemented; 
10 Figure 2 is a simplified block diagram illustrating one embodiment in which 

the methods and apparatuses for managing and presenting content through a 
spherical display device are implemented; 

Figure 3 is a simplified block diagram illustrating a system, consistent with 
one embodiment of the methods and apparatuses for managing and presenting 
15 content through a spherical display device; 

Figure 4 is an exemplary record consistent with one embodiment of the 
methods and apparatuses for managing and presenting content through a 
spherical display device; 

Figure 5 is a diagram illustrating an exemplary embodiment within which 
20 the methods and apparatuses for managing and presenting content through a 
spherical display device are implemented; 
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Figure 6A and 6B are diagrams illustrating an environment within which 
the methods and apparatuses for managing and presenting content through a 
spherical display device are implemented; 

Figures 7A, 7B, 7C and 7D are exemplary screen shots consistent with 
5 one embodiment of the methods and apparatuses for managing and presenting 
content through a spherical display device; 

Figure 8A, 8B, 8C are exemplary screen shots consistent with one 
embodiment of the methods and apparatuses for managing and presenting 
content through a spherical display device; and 
10 Figure 9 is a diagram illustrating an environment within which the methods 

and apparatuses for managing and presenting content through a spherical 
display device are implemented. 
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DETAILED DESCRIPTION 

The following detailed description of the methods and apparatuses for 
managing and presenting content through a spherical display device refers to the 
5 accompanying drawings. The detailed description is not intended to limit the 
methods and apparatuses for managing and presenting content through a 
spherical display device . Instead, the scope of the methods and apparatuses for 
managing and presenting content through a spherical display device are defined 
by the appended claims and equivalents. Those skilled in the art will recognize 
10 that many other implementations are possible, consistent with the present 
invention. 

References to "content" includes textual data, graphical data, video 
footage, digital images, audio data, and the like. 

In one embodiment, the methods and apparatuses for managing and 
15 presenting content through a spherical display device allow content to be 

captured simultaneously through multiple lenses, simultaneously display multiple 
content feeds to a viewer, manage multiple feeds of content through a unified 
interface. 

Figure 1 is a diagram illustrating an environment within which the methods 
20 and apparatuses for managing and presenting content through a spherical 

display device are implemented. The environment includes an electronic device 
110 (e.g., a digital camera, a video camera, a display device, and a projector for 
displaying content), a user interface 1 15, a network 120 (e.g., a local area 
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network, a home network, the Internet), and a server 130 (e.g., a computing 
platform configured to act as a server). 

In one embodiment, one or more user interface 115 components are 
made integral with the electronic device 110 (e.g., keypad and video display 
5 screen input and output interfaces such as a display and speakers in the same 
housing. In one embodiment, the user utilizes interface 1 1 5 to access and 
control content and applications stored in electronic device 110, server 130, or a 
remote storage device (not shown) coupled via network 120. 

In accordance with the invention, embodiments of managing and 

10 presenting content through a spherical display device below are executed by an 
electronic processor in electronic device 1 10, in server 130, or by processors in 
electronic device 110 and in server 130 acting together. Server 130 is illustrated 
in Figure 1 as being a single computing platform, but in other instances are two 
or more interconnected computing platforms that act as a server. 

15 In one embodiment, the electronic device 1 10 is a content capturing 

device such as a digital camera, a video camera, and an audio recorder. The 
content capturing device is utilized to capture content. In another embodiment, 
the electronic device 1 10 is a display device such as a screen, a monitor, a 
projector, and the like. The display device is utilized to display the content to at 

20 least one viewer. 

Figure 2 is a simplified diagram illustrating an exemplary architecture in 
which the methods and apparatuses for managing and presenting content 
through a spherical display device are implemented. 
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The exemplary architecture includes a plurality of electronic devices 110, 
a server device 130, and a network 120 connecting electronic devices 1 10 to 
server 130 and each electronic device 1 10 to each other. The plurality of 
electronic devices 1 10 are each configured to include a computer-readable 
5 medium 209, such as random access memory, coupled to an electronic 
processor 208. Processor 208 executes program instructions stored in the 
computer-readable medium 209. In one embodiment, a unique user operates 
each electronic device 1 10 via an interface 1 15 as described with reference to 
Figure 1. 

10 The server device 130 includes a processor 21 1 coupled to a computer- 

readable medium 212. In one embodiment, the server device 130 is coupled to 
one or more additional external or internal devices, such as, without limitation, a 
secondary data storage element, such as database 240. 

In one embodiment, the plurality of client devices 110 and the server 130 

15 include instructions for a customized application for managing and presenting 
content through a spherical display device. In one embodiment, the plurality of 
computer-readable media 209 and 212 contain, in part, the customized 
application. Additionally, the plurality of client devices 110 and the server 130 
are configured to receive and transmit electronic messages for use with the 

20 customized application. Similarly, the network 120 is configured to transmit 
electronic messages for use with the customized application. 

One or more user applications are stored in media 209, in media 212, or a 
single user application is stored in part in one media 209 and in part in media 
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212. In one instance, a stored user application, regardless of storage location, is 
made customizable based on managing and presenting content through a 
spherical display device as determined using embodiments described below. 

Figure 3 illustrates one embodiment of a system 300. In one embodiment, 
5 the system 300 is embodied within the server 130. In another embodiment, the 
system 300 is embodied within the electronic device 110. In yet another 
embodiment, the system 300 is embodied within both the electronic device 110 
and the server 130. 

In one embodiment, the system 300 includes a rendering module 310, a 
10 content capture module 320, a storage module 330, an interface module 340, a 
control module 350, and a content detection module 360. 

In one embodiment, the control module 350 communicates with the 
rendering module 310, the content capture module 320, the storage module 330, 
the interface module 340, and the content detection module 360. In one 
15 embodiment, the control module 350 coordinates tasks, requests, and 

communications between the rendering module 310, the content capture module 
320, the storage module 330, the interface module 340, and the content 
detection module 360. 

In one embodiment, the rendering module 310 produces signals that 
20 present content to a viewer. In one embodiment, the signals represent content 
such as audio data, image data, and a combination of audio/video data. 

In one embodiment, the content capture module 320 identifies the content 
that is being captured. In one embodiment, the content capture module 320 



PATENT 
SONY-06802 

organizes content that is captured simultaneously through multiple lenses. For 
example, a video camera having multiple lenses is capable of capturing multiple 
unique scenes simultaneously. The content capture module 320 manages 
capturing those multiple unique scenes. Further, the content capture module 320 
5 also coordinates the display of the content. 

In one embodiment, the storage module 330 stores the content organized 
by the content capture module 320. 

In another embodiment, the storage module 330 stores a record including 
information associated with a particular piece of content. An exemplary 
10 embodiment of the information contained within the record associated with the 
content is illustrated in Figure 4. 

In one embodiment, the interface module 340 receives a signal from one 
of the electronic devices 1 1 0 transmitting the content to the system 300. In this 
embodiment, the electronic device 1 10 is either a content capturing device or a 
1 5 content storage device. 

In another embodiment, the interface module 340 transmits rendering 
information from the rendering module 310 to present the content to a viewer. 

In yet another embodiment, the interface module 340 transmits rendering 
information from the rendering module 310 to an external display device such as 
20 a projector, a separate display screen, and the like. The external display is 
configured to be seen by the viewer. 

In one embodiment, the content detection module 360 monitors the 
capture of the content. In one embodiment, the content includes multiple images 
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captured simultaneously. For example, the content detection module 360 
records the location of each source device. In one embodiment, the location of 
the source device is attached to the corresponding piece of content as metadata 
and is shown as a profile information in Figure 4. 
5 The system 300 in Figure 3 is shown for exemplary purposes and is 

merely one embodiment of the methods and apparatuses for managing and 
presenting content through a spherical display device. Additional modules may 
be added to the system 400 without departing from the scope of the methods and 
apparatuses for managing and presenting content through a spherical display 

10 device . Similarly, modules may be combined or deleted without departing from 
the scope of the methods and apparatuses for managing and presenting content 
through a spherical display device . 

Figure 4 illustrates an exemplary record 400 identifying profile information 
corresponding to a particular piece of content for use with the methods and 

15 apparatuses for managing and presenting content through a spherical display 
device . In one embodiment, there are multiple records such that each record 
400 is associated with a particular piece of content. In one embodiment, the 
record 400 is stored as metadata for the corresponding content. In one 
embodiment, the record 400 includes a unique identifier field 410, a content type 

20 field 420, a content source field 430, and a content listing field 440. 

In one embodiment, the unique identifier field 410 uniquely identifies the 
content. In one example, a descriptive name is utilized to identify the content 
such as Uncle Bob's 50 th Birthday. 
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In one embodiment, the content type field 420 identifies the type of 
content associated with the particular content. For example, exemplary content 
types include video, audio, image, and the like. 

In one embodiment, the content source field 430 identifies the origin of the 
5 content. In one embodiment, the origin of the content refers to the particular 
capture device that captured the content. In another embodiment, the origin of 
the content also refers to the specific lens that captured the content when there 
are multiple lenses on the same capture device. For example, both the video 
camera and the particular lens that captured the content is identified in the 
10 content source field 430. 

In one embodiment, the content listing field 440 identifies related content. 
For example, if the same capture device captures different video footage through 
different lenses, then the content listing field 440 references these related video 
footage. 

15 Figure 5 illustrates one embodiment of a camera 500 for capturing and 

displaying content through a multi-lens system. The camera 500 includes a main 
housing 505, a first capture module 510, and a second capture module 515. In 
one embodiment, the camera 500 is represented as the electronic device 110. 
In one embodiment, the main housing 505 includes a spherical display 

20 520, a control knob 525, and a playback ring 530. In one embodiment, the 

spherical display 520 is configured to simultaneously display video/image content 
and functional menu driven content. In one embodiment, the spherical display 
520 is configured to simultaneously display multiple video feeds. 
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In one embodiment, the control knob 525 adjusts and controls the content 
and menu of the spherical display 520 in a vertical direction based on the 
direction that the knob 525 is turned. 

In one embodiment, the playback ring 530 rotates in both directions. In 
5 one embodiment, the playback ring 530 is utilized to control the direction (e.g. 
backwards, forward) and the speed of playing back the content such as video 
footage based on the rotation of the playback ring 530. In another embodiment, 
the playback ring 530 adjusts and controls the display of the content and menu 
on the spherical display 520 by rotating the objects in the display 520 
10 corresponding to a direction of the playback ring 530. 

In one embodiment, the first capture module 510 includes a lens module 
540 that is configured to capture visual content such as still images and video 
footage. In one embodiment, the first capture module 510 is removably coupled 
to the main housing 505. The first capture module 510 communicates with the 
15 main housing 505 via a wireless connection or a direct connection. In another 
embodiment, the first capture module 510 is permanently connected to the main 
housing 505. 

In one embodiment, the second capture module 515 includes a lens 
module 535 that is configured to capture visual content such as still images and 
20 video footage. In one embodiment, the second capture module 515 is removably 
coupled to the main housing 505. In another embodiment, the second capture 
module 515 is permanently connected to the main housing 505. 

The second capture module 515 communicates with the main housing 505 
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via a wireless connection or a direct connection. In one embodiment, the first 
and second capture modules 510 and 515 stream the visual content to the main 
housing 505 in real time via a wireless connection regardless of whether the 
capture modules 510 and 515 are physically connected with the main housing 
5 505. In another embodiment, the capture module 510 and 515 store the 

captured content and transmit the captured content to the main housing 505 in 
segments. 

In one embodiment, the capture modules 510 and 515 capture content at 
the same time. However, the captured content performed by the capture 
10 modules 510 and 515 are not the same and reflect a different view point or 
perspective of the corresponding capture module. 

The capture modules 510 and 515 are shown for illustrative purposes and 
any number of capture modules may be utilized with the main housing 505. 

In one embodiment, the capture modules 510 and 515 and the spherical 
15 display 520 enable a recording environment without a horizon. When capturing 
images of underwater sports, mid-air stunts, skydiving jumps, and the like, 
maintaining a proper orientation is difficult. 

In one embodiment, the capture modules 510 and 515 further include a 
sensor to detect the gravitation force such that the capture modules 510 and 515 
20 detects the direction towards the ground regardless of the orientation of the 
capture modules 510 and 515. In one embodiment, the sensor is a gyroscope. 
In another embodiment, the sensor is a mercury switch. 

In one embodiment, the spherical display 520 maintains a perpendicular 
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orientation to the gravitation force such that the images captured by the capture 
modules 510 and 515 and displayed on the spherical display 520 maintain the 
proper orientation even if the horizon is not part of the captured images. For 
example, the capture modules 510 and 515 continue to capture images and 
5 follow the subject regardless of the orientation of the capture modules 51 0 and 
515 with respect to the horizon. 

Figure 6A illustrates a front view of the spherical display 520 in greater 
detail. The spherical display 520 includes a playback ring 530, a playback head 
605, a current function display 610, and a display area 615. 

10 In one embodiment, the playback head 605 shows a graphical reference 

point of the current content that is being displayed on the spherical display 520. 
For example, instead of using a traditional time counter to track the current 
playback location of the content, the location of the playback head 605 illustrates 
the current playback location of the content, which portion of the content has 

15 already been viewed, and the portion of content that will be viewed. In one 

embodiment, as the content is played, the playback head 605 moves in a clock- 
wise direction. 

In one embodiment, the current function display 610 illustrates the current 
function of the spherical display 520. In one embodiment, the current function 
20 includes playback of content, capture of content, and the like. 

In one embodiment, the display area 615 displays the content and menu 
information to a viewer. The menu information allows the viewer to select 
particular content and select specific functions such as playback content and 
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capture content. In one embodiment, the display area 61 5 is curved to display 
the content in a three dimensional manner. Further, the display area 615 also 
displays the menu information. In yet another embodiment, the content and the 
menu information are simultaneously displayed on the display area 615. 
5 Figure 6B illustrates a side view of the spherical display 520 in greater 

detail. The spherical display 520 includes a display area 615. The display area 
615 includes a spherical display surface 625 and a flat display surface 620. In 
one embodiment, the spherical display surface 625 is a three dimensional display 
surface and is utilized to display either the content or the menu information. In 

10 one embodiment, the flat display surface 620 is a two dimensional display 
surface and is utilized to display either the content or the menu information. 

In one embodiment, the content is displayed on the spherical display 
surface 625, and the menu information is displayed on the flat display surface 
620. In another embodiment, the menu information is displayed on the spherical 

15 display surface 625, and the content is displayed on the flat display surface 620. 
By displaying the menu information and the content on different display surfaces 
(e.g. the spherical display surface 625 and the flat display surface 620), the 
menu information and the content are displayed simultaneously and legibly to the 
viewer. By displaying the menu information and the content simultaneously, 

20 there is no need to choose between exclusively viewing the content and the 
menu information. 

Figure 7A illustrates the spherical display 520 in the context of content 
shown within the display area 615. The display area 615 is shown with content 
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01 , content 02, and content 03. Each of the content 01 , 02, and 03 represents a 
different video footage from a particular lens. In one embodiment, the content 

01 , 02, and 03 are recorded at the same time from different lenses. In another 
embodiment, the content 01 , 02, and 03 originate from the same lens and are 

5 captured at different times. 

In one embodiment, a dividing demarcation 750 is shown dividing the 
content 01 , 02, and 03. In one embodiment, the playback ring 530 in 
combination with the knob 525 controls the allocation of the display area 615 
between the content 01 , 02, and 03. For example, by rotating the knob 525, the 
10 overall orientation of the content 01 , 02, and 03 is rotated. In this example, by 
rotating the playback ring 530, the amount of space allocated for the content 01 , 

02, and 03 is changed. In another example, by rotating the playback ring 530, 
the overall orientation of the content 01 , 02, and 03 is rotated. In this example, 
by rotating the knob 525, the amount of space allocated for the content 01 , 02, 

15 and 03 is changed. 

In another embodiment, instead of the areas of the content 01, 02, and 03 
representing different content, each of the areas of the content 01 , 02, and 03 
represent different special effects that are applied to different portions of the 
underlying content. The underlying content occupies the entire display area 615. 

20 Special effects include sepia tone, black and white tone, slow shutter effect, and 
the like. These special effects can be rendered in real-time. For example, the 
black and white tone is applied only to the content 01 and content 02 and 03 are 
left unaffected. In yet another embodiment, multiple layers of special effects are 
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applied to the underlying content. 

Figure 7B illustrates the spherical display 520 in the context of content 
shown within the display area 615. The display area 615 is shown with content 

01 , content 02, and content 03. The allocation of the display area 615 for the 

5 content 01 , content 02, and content 03 are changed from the content 01 , content 

02, and content 03 shown in Figure 7 A. In Figure 7B, a greater area of the 
display area 615 is allocated for the Content 01 , and content 03 compared to 
Figure 7A. 

Figure 7C illustrates the spherical display 520 in the context of content 
10 shown within the display area 615. The spherical display 520 includes the knob 
525, the playback ring 530, the playback head 605, and the current display 
function 610. In this example, the display area 615 is displaying a single content. 
In one embodiment, the content within the display area 615 is shown on the flat 
display surface 620. Further, the current display function 61 0 shows that the 
15 content displayed on the display area 615 is from "storage". 

Figure 7D illustrates the spherical display 520 in the context of content 
shown within the display area 615. The spherical display 520 includes the knob 
525, the playback ring 530, and the current display function 610. In this example, 
the display area 615 is displaying a multiple menu items 705. In one 
20 embodiment, the multiple menu items 705 within the display area 615 are shown 
on the spherical display surface 625. In another embodiment, content such as 
video footage is displayed simultaneously with the menu items 705. The content 
is displayed on the flat display surface 620 to differentiate the menu items 705 
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from the content. 

Further, the current display function 610 shows that the menu items 705 
on the display area 615 are from "menu". In this embodiment, the knob 525 is 
utilized to scroll through the menu items 705. 
5 Figure 8A illustrates the spherical display 520 in the context of content 

shown within the display area 615. The spherical display 520 includes the 
playback ring 530, the playback head 605, and the current display function 610. 
In one embodiment, the display area 615 allows a subject 810 within the display 
area 615 to be enlarged. The current display function 610 is shown in the "focus" 
10 mode. 

In one embodiment, the display area 615 includes a focus ring 805 and 
the subject 810. In one embodiment, the focus ring 805 is movable within the 
display area 615 and displays content within an area of the focus ring 805 that is 
to be enlarged. For example, if it is desired to enlarge the subject 810 that is 

15 shown within the display area 615, the focus ring 805 is moved such that the 
focus ring 805 encompasses the subject 810. In one embodiment, the playback 
ring 530 is utilized to move the focus ring 805. 

In another embodiment, the cursor keys 830 are utilized to position the 
focus ring 805 within the display area 615. The focus ring 805 is utilized to 

20 enlarge or shrink the focus ring 805 depending on the direction that the focus ring 
805 is rotated. 

Figure 8B illustrates the spherical display 520 in the context of content 
shown within the display area 615. The focus ring 805 is shown encompassing 
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the subject 810 within the display area 615. 

Figure 8C illustrates the spherical display 520 in the context of content 
shown within the display area 615. The subject 810 is shown enlarged within the 
display area 615 relative to the subject 810 in Figures 8A and 8B. The focus ring 
5 805 is shown encompassing the subject 810 within the display area 61 5. 

In one embodiment, the enlargement process is accomplished by 
capturing a much wider perspective with a wide angle lens such as a fish eye 
lens as shown in Figure 8A. When an enlargement is desired, the area within the 
focus ring 805 is enlarged, and the content of the surrounding areas outside the 

10 focus ring 805 are ignored. However, the content of the surrounding areas 
outside the focus ring 805 are continually captured even if they are not shown 
within the display area 615 of Figure 8C. For example, regardless of the 
enlargement that is requested via the focus ring 805, the entire wide angle 
perspective as shown in Figure 8A is still being captured. 

15 Figures 8A, 8B, and 8C utilize the display head 605 to visually display the 

which portion of the content is being displayed within the display area 615. In 
one embodiment, the video segment (content) advances forward as the display 
head 605 rotates counter-clockwise. For example, the content within the display 
area 615 in Figure 8A is shown prior to the content within the display area 615 in 

20 Figure 8B. Further, the content within the display area 615 in Figure 8B is shown 
prior to the content within the display area 615 in Figure 8C. 

Figure 9 illustrates a system 900 for displaying content. In one 
embodiment, projector 905, projector 910, and projector 915 receive content from 
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a capture device 920 such as a digital camera, a video camera, and the like. The 
projectors 905, 910, and 915 are portable and configured to display content by 
projecting the content onto a surface. In one embodiment, each of the projectors 
905, 910, and 915 is associated with unique content. For example, each of the 
5 projectors 905, 910, and 915 is associated with a unique lens which transmits a 
different video feed. 

In use, the capture device 920 transmits content to the projectors 905, 
910, and 915. In one embodiment, the projectors 905, 910, and 915 are focused 
in a particular direction and show the associated content with the particular 

10 projector. In one embodiment, each of the projectors 905, 91 0, and 91 5 is aimed 
in an exclusive area to display their associated content without interference or 
overlap of other content. In another embodiment, some of the projectors 905, 
910, and 915 are aimed to overlap each other thus creating a combination of 
multiple pieces of content. 

15 In one embodiment, a projection 925 displays content that originates from 

the projector 905; a projection 935 displays content that originates from the 
projector 910; and a projection 930 displays content that originates from the 
projector 91 5. The projections 925, 930, and 935 are examples of content that 
are shown in an exclusive area with no overlap. A projection 940 displays a 

20 combination of content originating from the projector 905 and the projector 91 0. 
A projection 950 displays a combination of content originating from the projector 
905 and the projector 915. A projection 945 displays a combination of content 
originating from the projector 910 and the projector 91 5. A projection 960 
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displays a combination of content originating from the projector 905, the projector 
910, and the projector 915. The projections 940, 945, 950, and 960 are 
examples of content that is shown overlapping with multiple pieces of content 
thus creating a combination of multiple pieces of content. 

5 The foregoing descriptions of specific embodiments of the invention have 

been presented for purposes of illustration and description. The invention may 
be applied to a variety of other applications. 

They are not intended to be exhaustive or to limit the invention to the 
precise embodiments disclosed, and naturally many modifications and variations 

10 are possible in light of the above teaching. The embodiments were chosen and 
described in order to explain the principles of the invention and its practical 
application, to thereby enable others skilled in the art to best utilize the invention 
and various embodiments with various modifications as are suited to the 
particular use contemplated. It is intended that the scope of the invention be 

15 defined by the Claims appended hereto and their equivalents. 
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